Papers with probing model
Information-Theoretic Probing with Minimum Description Length (2020.emnlp-main)
Copied to clipboard
| Challenge: | Despite widespread adoption of probes, differences in their accuracy fail to adequately reflect differences in representations. |
| Approach: | They propose an alternative to the standard probes, information-theoretic probing with minimum description length (MDL). |
| Outcome: | The proposed method agrees in results and is more informative and stable than the standard probes. |
Probing Contextual Language Models for Common Ground with Visual Representations (2021.naacl-main)
Copied to clipboard
| Challenge: | Contextual language models have attracted great interest in probing what is encoded in their representations. |
| Approach: | They propose a probing model that evaluates how effective are text-only representations in distinguishing between matching and non-matching visual representations. |
| Outcome: | The proposed model outperforms text-only language models in instance retrieval, but underperform humans. |
Transferable and Efficient Non-Factual Content Detection via Probe Training with Offline Consistency Checking (2024.acl-long)
Copied to clipboard
| Challenge: | Existing factuality detection methods are not effective for large language models (LLMs). |
| Approach: | They propose a probing model that trains on offline consistency checking results. |
| Outcome: | The proposed model reduces the computational burden of generating multiple responses by online consistency verification and improves on factuality detection and question answering benchmarks. |
Probe Then Retrieve and Reason: Distilling Probing and Reasoning Capabilities into Smaller Language Models (2024.lrec-main)
Copied to clipboard
| Challenge: | Recent research efforts have focused on distilling Large Language Models into Small Language Model (SLMs) however, the results of CoT distillation are inadequate for knowledge-intensive reasoning tasks. |
| Approach: | They propose a retrieval-based framework which distills question probing and reasoning capabilities from Large Language Models into SLMs. |
| Outcome: | The proposed framework improves probing and reasoning capabilities of large language models in knowledge-intensive reasoning tasks. |